A semi-blind maximum likelihood approach for resolving linear convolutive mixtures
نویسندگان
چکیده
We introduce a new technique to separate a linear convolutive mixture of discrete-time sources, emitting uncorrelated data samples. The proposed approach works in the reduced dimension space of the (channel) whitened data samples, where the data matrix is highly structured: it is the product of an orthogonal and generalized Toeplitz matrices embedded in additive Gaussian noise. By itself, this factorization does not unambiguously determine the sources (even in the absence of noise), but uniqueness is restored if short fragments (inadequate for training) of the emitted messages are known beforehand. We present a locally convergent iterative algorithm which implements the joint maximum likelihood (ML) estimator of both the orthogonal mixing matrix and the user signals, subject to the known side information. We also discuss a simple (sub-optimal) adaptation of the proposed algorithm to the class of finitealphabet (FA) sources. Computer simulations show that the proposed technique permits to outperform an alternative subspace approach, specially in low signal-to-noise ratio (SNR) scenarios. 1. PROBLEM FORMULATION Methods for separating linear convolutive mixtures find direct application in many important signal processing areas, e.g., in space division multiple access (SDMA) wireless networks, where the base station has to discriminate a linear superposition of user signals transmitted over multipath channels see 11, 2, 3, 41 and the references therein. The conditional or unconditional ML techniques in 11, 21 address the problem of instantaneous mixtures for FA sources, whereas (3, 41 are not full ML approaches. Here, we introduce a semi-blind ML based technique to resolve convolutive mixtures. The side information is needed because the proposed technique is not restricted to FA sources, and uses only 2nd order statistics. The paper is organized as follows. Section 2 establishes the data model and states the main assumptions. Section 3 describes the joint ML estimator of the orthogonal mixing matrix and the user signals. Section 4 addresses some computational and implementation issues concerning the proposed algorithm. In section 5 , we compare our proposed technique with the subspace approach [3], through computer simulations. Notat ion. Matrices (capital) and vectors are in boldface type. RnX" is the set of n x m matrices with real entries. The notations ( . ) T , (.)+, 8, 0, t r {.}, and vec (.) stand for the transpose, Moore Penrose pseudo inverse, Kronecker product, Hadamard product, the trace, and the vectorization operator, respectively. The symbols I , and O n X , represent the n x n identity matrix and the all-zero n x m matrix, respectively (when the dimensions are clear from the context, we drop the subscripts). Within WX", we single out the subsets 9, = { Q : QTQ = I , } (group of orthogonal matrices), R, = { H : H = HT } (subspace of symmetric matrices) and its orthogonal complement K, = { K : K = -KT } (subspace of skew-symmetric matrices). For a vector 8 = [ 81 192 . . . 01 1' E RI, TnX, (e) denotes the n x m Toeplitz matrix generated by 8, i . e . , e' 1 r en e,, en+2 . . . where m + n 1 = 1. Diagonal concatenation of the matrices Ai, i = 1 , 2 , . . . , n (not necessarily sharing the same dimensions) is denoted by diag (AI, . . . , An). We write a: N (p , C ) , if the random vector a: is Gaussian distributed with mean p and covariance matrix C . 2. DATA MODEL AND ASSUMPTIONS Consider a noisy linear convolutive mixture of P discretetime sources, Here, a : ( k ) E WN denotes the vector of channel outputs, {h, ( 1 ) E RN : 1 = 0,1, . . . , L, l } is the finite-impulse response (FIR) of the multichannel filter corresponding to the pth user (L , denotes the pth user channel length), 0, ( k ) E W is the scalar signal transmitted by the pth user, and w ( k ) E WN denotes additive noise. Equation (1) may be 0-7803-6293-4/00/$10.00 02000 IEEE. 2809 compactly rewritten as system outputs, R, = E {z ( k ) 2 ( k l T } = p v u ~ + ~ 2 r N , (3)
منابع مشابه
A Maximum Likelihood Approach to Nonlinear Convolutive Blind Source Separation
A novel learning algorithm for blind source separation of postnonlinear convolutive mixtures with non-stationary sources is proposed in this paper. The proposed mixture model characterizes both convolutive mixture and post-nonlinear distortions of the sources. A novel iterative technique based on Maximum Likelihood (ML) approach is developed where the ExpectationMaximization (EM) algorithm is g...
متن کاملOn-line Convolutive Blind Source Separation of Non-Stationary Signals
A novel algorithm is proposed in this paper to solve blind source separation of post-nonlinear convolutive mixtures of non-stationary sources. Both convolutive mixing and post-nonlinear distortion are included in the proposed model. Based on the generalized Expectation-Maximization (EM) algorithm, the Maximum Likelihood (ML) approach is developed to estimate the parameters in the model. A set o...
متن کاملBlind separation of convolutive image mixtures
Convolutive mixtures of images are common in photography of semi-reflections. They also occur in microscopy and tomography. Their formation process involves focusing on an object layer, over which defocused layers are superimposed. We seek blind source separation (BSS) of such mixtures. However, achieving this by direct optimization of mutual information is very complex and suffers from local m...
متن کاملA general approach for mutual information minimization and its application to blind source separation
In this paper, a non-parametric “gradient” of the mutual information is first introduced. It is used for showing that mutual information has no local minima. Using the introduced “gradient”, two general gradient based approaches for minimizing mutual information in a parametric model are then presented. These approaches are quite general, and principally they can be used in any mutual informati...
متن کاملAdaptive blind separation of convolutive mixtures of independent linear signals
This paper is concerned with the problem of blind separation of independent signals (sources) from their linear convolutive mixtures. The various signals are assumed to be linear non-Gaussian but not necessarily i.i.d. Recently an iterative, normalized higher-order cumulant maximization based approach was developed using the fourth-order normalized cumulants of the \beamformed" data. A byproduc...
متن کاملAlgorithmes temporels rapides de type point fixe pour la séparation aveugle de mélanges convolutifs Time-domain fast fixed-point algorithms for blind separation of convolutive mixtures
This paper presents new blind separation methods for Moving Average (MA) convolutive mixtures of independent MA processes. They consist of time-domain extensions of the FastICA algorithms developed by Hyvärinen and Oja for instantaneous mixtures. They perform a convolutive sphering in order to use parameter-free fast fixed-point algorithms associated with kurtotic or negentropic nongaussianity ...
متن کامل